Description

This PR enable iceberg connector to use S3 location as warehouse dir for Hive file catalog.

By configuring the s3 properties described in https://prestodb.io/docs/current/connector/hive.html#amazon-s3-configuration, we can specify a S3 location as the warehouse dir of Hive file catalog. This way, both metadata and data
of iceberg tables will be maintained on S3 storage.

An example configuration includes:

    connector.name=iceberg
    iceberg.catalog.type=HIVE
    hive.metastore=file
    hive.metastore.catalog.dir=s3://iceberg_bucket/warehouse


    hive.s3.use-instance-credentials=false
    hive.s3.aws-access-key=accesskey
    hive.s3.aws-secret-key=secretkey
    hive.s3.endpoint=http://192.168.0.103:9878
    hive.s3.path-style-access=true

Motivation and Context

Support specifying a S3 location directly as warehouse dir for Iceberg with Hive file catalog

Impact

N/A

Test Plan

• Manually confirmed in local environment (including Ozone and MinIO)
• Make sure this change do not affect any existing test cases
• Newly added test class to run test cases in IcebergDistributedTestBase on S3 storage provided by dockerized MinIO

Contributor checklist

• Please make sure your submission complies with our contributing guide, in particular code style and commit standards.
• PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
• Documented new properties (with its default value), SQL syntax, functions, or other functionality.
• If release notes are required, they follow the release notes guidelines.
• Adequate tests were added if applicable.
• CI passed.

Release Notes

== RELEASE NOTES ==

Iceberg Connector Changes
* Enable iceberg connector to use S3 location as warehouse dir for ``Hive`` file catalog. :pr:`24328`